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Abstract 

Raptor codes have been widely used in many multimedia broadcast/multicast applications. However, 
our understanding of Raptor codes is still incomplete due to the insufficient amount of theoretical work 
on the performance analysis of Raptor codes, particularly under maximum-likelihood (ML) decoding, 
which provides an optimal benchmark on the system performance for the other decoding schemes to 
compare against. For the first time, this paper provides an upper bound and a lower bound, on the packet 
error performance of Raptor codes under ML decoding, which is measured by the probability that all 
source packets can be successfully decoded by a receiver with a given number of successfully received 
coded packets. Simulations are conducted to validate the accuracy of the analysis. More specifically. 
Raptor codes with different degree distribution and pre-coders, are evaluated using the derived bounds 
with high accuracy. 
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I. Introduction 

Recent work has shown that, by applying rateless codes, wireless transmission efficiency and 
reliability can be dramatically improved 0 ]|, [ 121 , 0 . Rateless codes are a class of forward 
error correction (FEC) codes with special properties. Compared with other FEC codes with 
finite length, such as the Reed-Solomon codes, Block codes and Convolutional codes, rateless 
codes have numerous advantages. Firstly, this class of codes can be implemented with far less 
complicated encoding and decoding algorithms, making such codes easy to be employed in 
modern communication systems. Secondly, they can automatically adapt to instantaneous channel 
states and avoid the need for feedback channels 0, 0, 0. This is because rateless codes 
can generate a potentially limitless stream of coded packets, and when a sufficient number of 
coded packets are successfully received, all source packets can be correctly decoded. Hence, 
for certain channels, such as erasure multicast or broadcast channels whose real-time channel 
erasure probability estimation might be nearly impossible to obtain, and non-uniform channels 
or time-varying channels whose channel states are unknown or difficult to capture due to 
fast variation, rateless codes are desirable means for data transmission. Because of the above 
mentioned advantages, rateless codes have the potential to replace the conventional automatic 
repeat request (ARQ) mechanism as a new mechanism of transmission control protocol (TCP) 
0 . 

Among the known rateless codes, two codes stand out. One is the LT codes, which is the first 
practical digital fountain code with the average decoding cost in the order of 0(k log (A')) 0. The 
other one is the Raptor codes, which are the first class of fountain codes with linear time encoding 
and decoding complexities. Raptor codes are concatenated codes, which combines a traditional 
FEC with an LT code to relax the condition that all input symbols need to be recovered in an 
LT decoder. Moreover, Raptor codes only require 0(1) time to generate an encoding symbol 
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IDQ. Note that Raptor codes have already been standardized in 3GPP to efficiently disseminate 
data over a broadcast/multicast network to provide MBMS service [0. 

Despite the successful application of Raptor codes in 3GPP, our understanding of Raptor 
codes is still incomplete due to the insufficient amount of theoretical work on the performance 
analysis of Raptor codes. Without analytical results, the optimization of the degree distribution 
as well as the parameters for Raptor codes would be extremely difficult, if not impossible. In 
m, Shokrollahi provided a decoding error probability analysis of Raptor codes with finite length 
under the assumption of the belief propagation (BP) decoding. The analysis relies on the exact 
calculation of the error probability of the LT codes under the BP decoding, which was derived 
in [13. The maximum-likelihood (ML) decoding, on the other hand, is more computational 
demanding than the BP decoding for codes with large length. Nevertheless, the derivation of 
bounds of decoding error probability for the ML decoding is still meaningful, because it provides 
an optimal benchmark on the system performance for the other decoding schemes to compare 
against. In this light, for Raptor codes with limited lengths, i.e. in the order of a few thousands, 
Shokrollahi proposed a decoding algorithm based on the maximum-likelihood (ML) criterion in 
lf8l . Furthermore, in d5j, the authors proposed a method to compute the upper and lower bounds on 
the bit error rate (BER) of Raptor codes under the assumption of the ML decoding. However, the 
work in d5j needs to be improved or re-examined in some aspects. Firstly, the pre-coder assumed 
in 0 is impractical. In more detail, all the entries of the parity check matrix of the pre-coder are 
assumed to be independent and identically distributed (i.i.d) Bernoulli random variables, so it is 
possible that the parity check matrix of the pre-coder may become ill-conditioned, rendering no 
generator matrix working with the parity check matrix. Hence, the analytical bounds proposed 
in (51 cannot be verified via simulation. Secondly, the derived bit error probability of Raptor 
codes under ML decoding in 0 is for the intermediate bits of Raptor codes rather than the 
source bits of Raptor codes. So the decoding error performance of Raptor codes still needs 
further investigation. In our pervious work (9j, we proposed a wireless broadcast scheme based 
on network coding in a single tier cellular network. In this paper, we further treat Raptor codes 
by analyzing the performance of the source bits of Raptor codes, i.e., all source bits can be 
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successfully decoded with ML decoding by a receiver with a given number of successfully 
received coded bits, and verifying the derived results via simulations. The contributions of this 
work are summarized in the following: 

• This paper, for the first time, provides the analytical result, i.e., an upper bound and a lower 
bound, on the packet error performance of Raptor codes under maximum-likelihood (ML) 
decoding, which is measured by the probability that all source packets can be successfully 
decoded by a receiver with a given number of successfully received coded packets. 

• Simulations are conducted to validate the accuracy of the analysis. More specifically, Raptor 
codes with different degree distribution and pre-coders, are evaluated using the derived 
bounds with high accuracy. According to our study, we conclude that Raptor codes with 
the binomial distribution achieve the best performance among the investigated ones. 

The rest of the paper is organized as follows. In Section |TT1 a brief review of the encoding 
and decoding process of Raptor codes is given. In Section [Till performance analysis of Raptor 
code is conducted by deriving an upper bound and a lower bound on the probability that all 
source packets can be successfully decoded by a receiver with a given number of successfully 
received coded packets. Section|IV] validates the analytical results through simulations, followed 
by concluding remarks in Section 0 

II. An Introduction to Raptor Codes 

This section is provided to familiarize the readers with the basic idea of Raptor codes, their 
efficient encoding and decoding algorithms. 

The encoding process of Raptor codes is carried out in two phases: a) Encode k source 
packets with an (n, k) error correcting code referred as pre-code C to form n intermediate 
packets; b) Encode the n intermediate packets with an LT code. Each coded packet is generated 
by the following encoding rules of LT code. Firstly, a positive integer d (often referred to as 
the “degree” 0 of coded packets) is drawn from the set of integers {l,...,n} according to 
a probability distribution f2 = (Q,,Q„), where Q,/ is the probability that d is picked and 
Yld=i - f/ = 1- Then, d distinct source packets are selected randomly and independently from the 
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Figure 1. Two-stage structure of a Raptor code with a sysmatic pre-code. 


n intermediate packets to form the coded packet to be transmitted using the XOR operation 0]|, 
HI . where each source packet is selected with equal probability. A Raptor code with parameters 
(k, C, fi) is an LT code with distribution f2 = (f^,..., Q n ) on n packets that are the coded packets 
of the pre-code C. An illustration of a Raptor code is given in Figure HI In this study, we assume 
that the pre-code is an (n, k ) systematic LDPC code whose generator matrix, G^ fc , can always 
be written as Gf L ^ k = [Ifc|Pfcx(n-fc)] T > where I& is an identity matrix of size k, and P kx(n-k) is a 
k by [n — k) matrix with its entries being independent and identically distributed (i.i.d) Bernoulli 
random variables with parameter 77 . Such code is denoted as (n, k. rf) LDPC code Further, we 
can obtain the parity check matrix of this LDPC code as H( n _ fe w n = [P ( n _k)xk |I(n—fc)](n—fc)xn 
and H( n _ fc ) xn x G^ fc = 0. In case where generator matrix of pre-code is a deterministic matrix, 
i.e., a typical (n, k ) error correction code, there are well known methods to handle the situation 
and actually make our analysis easier. 

When a coded packet is received by a MU, we use a 1 x k binary row vector gJ ;i G pre to 
represent the coding information contained in the coded packet, where g ? LT is a 1 x n binary 
row vector and G pre is a n x k binary matrix. Let [G]. . denote the entry in the i th row and the 
j th column of a matrix G. Particularly, [gf T ] is 1 if the coded packet is a result of the XOR 
operation on the j th intermediate packet (and other intermediate packets); otherwise [gf T ] 1 . 
equals 0. For [G pre ] i ■ , it is 1 if the i th intermediate packet is a result of the XOR operation 
on the j th source packet (and other source packets); otherwise [G pre ] ij equals 0. Therefore, a 
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random row vector in this paper refers to the row vector of a randomly chosen coded packet 
where the coded packet is generated using the Raptor encoding process described above. Recall 
that s = (si, S 2 ,Sfc) represents the k equal-length source packets to be transmission. The 
coded packet can be expressed as: y, ; = gh T G pre s T , where “s T ” is transpose of s. 

Raptor codes can be decoded by using a variety of decoding algorithms. A typically used 
decoding algorithm for Raptor Codes is the so-called “LT process” |4], but it is well known 
that the LT process is unable to decode all source packets which can be possibly recovered 
from information contained in the received coded packets. For example, LT process relies on the 
existence of at least one degree-one coded packet to be received in order to start the decoding 
process. For Raptor codes with limited lengths, i.e. on the order of a few thousand, maximum- 
likelihood (ML) decoding has been proposed to replace LT process. Therefore, in this paper we 
use a different decoding algorithm called the inactivation decoding algorithm |[8l to decode the 
source packets. This decoding algorithm combines the optimality of Gaussian elimination with 
the efficiency of the “LT process” algorithm. Specifically, let m, (m > k), be the number of coded 
packets that have already been successfully received by a MU. The performance of inactivation 
algorithm is the same as Gaussian elimination. One way to apply Gaussian elimination on raptor 
code is to solve a system of linear equations given in the following IfTOl . 


/ 


\ 


G 


LT 


/ 


/pPi'e ) 

nxk^kxl) 


Y H( n _fc)xn J 


\ 


Y mx i 

Y 0(n—fc)xl J 


where Y mx i = (yi, yj,.... y m ) 7 . Additionally, we can obtain the following Lemma: 


Lemma 1. A MU can recover all k source packets from the m coded packets using the 
inactivation decoding algorithm if and only if (G /T ; H( n _ t .) x „)( m+n _; 1 .)x n is a full rank matrix, 
i.e. its rank equals n, which is equivalent to the event that (G LT G pre ) mX k A a full rank matrix. 


Proof: The proof of this statement is provided in Appendix A. ■ 

Note that in this paper, all algebraic operations and the associated analysis are conducted in 
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a binary field. Obviously the event that ( G LT G pre ) rr , x /. is a full rank matrix is equivalent to the 
event A k rn that a MU can successfully decode all A: source packets using inactivation decoding 
algorithm provided the event that the MU has successfully received m coded packets. The main 
result of this paper is summarized in Theorems [2] and [3} 


III. Performance Analysis of Raptor Codes 


Denote by A k n the event that a receiver can successfully decode all k source packets condi¬ 
tioned on the event that the receiver has successfully received m coded packets which is encoded 


with Raptor code from the BS. In this section, we shall analyze the probability of A^. 

Because of the equivalence between the event A k n and the event that (G LT G pre ) mX fc is a full 


rank matrix, the analysis of Pr (A k n ) is conducted by analyzing the probability that the rank of 

(G LT G pre ) roxfe is k. 


A. Lower Bound on the Decoding Success Probability of Raptor Codes 

In this subsection, we will derive a lower bound on the decoding success probability of Raptor 
codes with systematic pre-code, which is presented in the following theorem: 

Theorem 2. When the BS generates coded packets using the Raptor code (A;, C, Q(x)) where 
C is ( n,k,rj) LDPC code and the coded packets received at a mobile user (MU) are decoded 
using the inactivation decoding algorithm, the probability that a MU can successfully decode 
all k source packets from m received coded packets with m> k , denoted by Pr (A k r \, is lower 


bounded by 


k 


n-k-\-i 



(i) 


where 


J(r) 
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D(i,r) =(?!?) 


1 + (1 - 2ri)‘ 


n-k—r-\-i 


X 


1 - (1 - 2 r]Y 


and 1 l<i is the degree distribution of LT codes. 


Proof: Our proof relies on the use of the union bound of the independent events that vectors 
in the column vector space of G^ xfc are in the null space of G\f xn . 

According to the property of the matrix product [11, Eq. (4.5.1)], we have 


rank(G™ xn G p * xk ) 

= rank( G£*) - dim{7V(G“ J 0 R( G£ fc )} 


where N(») is the right-hand null space of a matrix, /?(•) is the column vector space generated 
by a matrix and climjV} represents number of vectors in any basis for a vector space V. It 
follows from the definition of G v 'f k given earlier that the rank of Gff k surely is k. It can be 
readily obtained that: 


Pr[ranfc(G“ „G£ 4 ) = k] 

= Pr[dim{JV(G“ „) n fl(G"^)} = 0] 


( 2 ) 


For convenience let W rn , n ^. represent the event that dim{A^(G^ xn ) D R(G^ xk )} = 0. Now we 
need to analyze Pr|W m)n:fe ]. Provided that G^ r xfc is a (n. k, p) systematic LDPC code, the event 
dim{A^(G^ xn ) nf?(G^ r xfc )} 7 ^ 0 , i.e., W m , n ,k, is equivalent to the event that at least one column 
vector from R(G p * xk ) is among N{G^ xn ), i.e., U xefl(G r» fc) G£ Xn x = 0, where x is a column 
vector of R(Gf lxk ). It can be readily shown that: 


Pr [W, 


m,n,k\ 


= Pr 


U. 


xGH( Gj” 


r"'LT Y _ n 
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< E Pr [ G “ „x = o] (3) 

^R(G7xk) 

The column vector space R( G^ r xfc ) is partitioned into k subspace ( Vi. V 2 , • •., V/,j and V, is the 
subspace that contains all the column vectors which are summation of i column vectors of G^ xfc . 
We denote T, as the set of indices of the column vectors in V, and there are (f) indices in T,. 
Let x l a represent the a th , a E T t column vector in V,. It can be readily shown that: 

k 

Y Pr[G“„x = 0]=y; £ Pr[G“ „xl = 0] (4) 

*eR(G p „ re xfc ) i=1 aeFi 

We can observe that x* = G“ xi l* where G“ xi is the matrix formed by i selected column 
vectors from k column vectors of G'’ r xA , and 1, represent the i x 1 all one column vector. Let 
|x^| represent the weight of column vector x‘ a , considering the law of total probability, we have 

Pl '[Gm Xr X = 0] 

n 

= S Pr 

r =0 

Firstly, we need to calculate Pr [|x* — r]. Provided G^ xfc = [Ik\Pkx(n-k)] T , in the first k entries 
of G“ xi lj there are i ones. If x* = r, then there are r — i ones in the last n — k entries of 
G“ xi lj, .i.e, P“ n _ fc)xi lj. Hence we can obtain that 

Pr[K|=r] = Pr[|P“„_ t)x ,l,| = (r-i)] (6) 

and i < r < n — k + i. The rows of P? n _ fe ) xi , i.e., p j, 1 < j < (n — k), are random binary 
row vectors, which are generated independently. Each entry of PL_ fc ^ xi is independent and 
identically distributed (i.i.d) Bernoulli random variable with parameter p. Therefore, Pr[p ; T, = 
0] = Pr[p fc)fe ^jlj = 0]. The event that the j th entry in x* is zero is equivalent to the event that 
there are even number of ones in row vector p y . We have 

Pr[pjlj = 0] = Pr [|pj| is even ] 


G LT x* 

mxn a 


= o 


= r 


Pr x* = r 


(5) 
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E C.M 1 - 

*=0.2.2[iJ 

[( ? 7 + (1 ~ 7 l)Y + (~ 7 7 + (1 ~ ? ?)) i ] 

2 

1 + (1 - 277)* m 

2 ( 

There are (”zf) possible combination for r — i ones in the last n — k entries. It can be readily 
shown that: 


Pr [|P“ n _ fc)xi li| = {r -i)] 
= rf){Pr[p,-l, = 


x{l-Pr[p i l i = 0]} r - < 


( 8 ) 


Combining equations ©, © and ([8]), we can obtain that 


D(i, r) — Pr [|x„| = r] 

fi + (i- 2vY in - k ~ r+i 


x 


2 

(i - 2 v y 


(9) 


For x* a ,x^ a e Vi, P( n _ fe ) xi and P( n _ fc \ xi have the same probability to form the same matrix 


formation. So we can obtain that Pr 


r (n— fc)xi i * 


= r 


= Pr 


(n— 


= r 


, in 


turn Pr [|x*J = r] = Pr [|x|| = r]. Now, we calculate Pr [G^ n x* = 0 | |x„| = r] . The rows of 
Gjjj'xn, i.e., gf, 1 < j < m, are random binary row vectors, which are generated independently. 


We have 


Pr 

Pr 


G LT x* = 0 

^mxn^a u 


xi = r 


g = 0 


( 10 ) 


The degree of g' ;r . i.e. the number of non-zero elements of g' ;r , is chosen according to the pre¬ 
defined degree distribution O = (fix,..., Q n ) and each non-zero element is then placed randomly 
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and uniformly into g'-' 1 . It can be readily obtain that 


Pr [gfx‘ = 0 

x l a = r 

n 

£ n “ Pr [sf 

d= 1 

xi = 0 x 


( 11 ) 


Let r* 


(gii x ai,giJxl 2 ,-,ginxi n ), where is 


[gf]l,fc and X afc is [<] fc ,l- Then ’ we can 


obtain that 


Pr 
= Pr 


g = o 


is even 


*\=r,\$\ = d 

kl =r,|gf| =d 




s=0,2,...,2[%\ L 


)ri) 


Combining equations (fill) and (fl2l) . we can obtain that 


( 12 ) 


J(r) 


Pr 


d=l 


sfK = o 

E s =, 


S =0,2,...,2[#J U 


X a | = r 

)ri) 


(3) 


Inserting equation (flOl) into (fl3l) . it can be obtained that 


(13) 


Pr 

G L l.r,< — 0 

_i 


mXn a 

1 a 1 


[J(r)) 


(14) 


We can obtain that Pr[G^ xn x^ = 0 | |x^| = r] is only determined by the weight of x':, rather 
than which i column vectors is chosen from G pr E to obtain the summation x*. So we can 

nxk cl 

conclude that Pr|G|; r xrj x’ ( = 0] = Pr[G^ xn x£ = 0]. Recall that there are (- : ) indices in I',. 
Inserting equations ([9]) and (fl4l) into © and combining with equation ©, yields the following 
results 


P*[ W m,n,k\ 

< Xi^Pr[G“„xi = 0] 

i =i aery 
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n—k-\-i 


= £(?) E 

i=l i 

x (IS?) 

which proves the assertion. 


.< 2=1 


S s =0,2,...,2[|J (s 


_ r \ -i m 


)(H) 


-1 

1— 1 

+ 

1 

to 

n—k—r-\-i 

i 

i 

i 

to 

e*. 

_1 

2 


2 


(15) 


5. Upper Bound on the Decoding Success Probability of Raptor Codes 

In addition to the above lower bound, we can also derive an upper bound on the decoding 
success probability of Raptor codes with systematic pre-code, which is presented in the following 
theorem: 

Theorem 3. When the BS generates coded packets using the Raptor code (k,C,Q(x)) and the 
coded packets received at a mobile user (MU) are decoded using the inactivation decoding 
algorithm, the probability that a MU can successfully decode all k source packets from m 
received coded packets with m > k , denoted by Pr (/l^ ), is upper bounded by: 

Pr (4t) 

k n—k+i 

< l-E© E (Ar)) m D(i,r) 

2—1 r=i 

-t k i k—i 

+ 2 XX*) X X X + w 2 )l(wi + w 2 ) 

2— 1 WQ=0 Wl=i — WQ W2=0 

n-kf-WQ n-k-\-w\ n-k-\-W2 

x(L 0 )fe‘) E E E D (wo,r o)D(w u r 1 ) 

ro=wo r\ =w\ ro=W 2 

x D(w 2 ,r 2 ){J(r 0 )J(r 1 )J(r 2 ) + J(r 0 )J(r 1 ) J(r 2 )} m (16) 


where 


!(e) 


{ 0 ifx = 0 
1 otherwise 


J(-) = 1 — J(-), D(wo,r 0 ) is defined in equation ([£]) and J{rf) is defined in equation Hl\) . 
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Proof: By using the Bonferroni inequality [?], we can obtain a lower bound of Pr \W m ^k\ 
as: 


Pr \W m ,n,k] 

= Pr[U xeR ( G p« fc) G^ xn x = 0] 

> £ Pl 1 G “ » x = 0 ] 
x eR(Gf x) ,) 

X Pr l G -« x = 0&G^ xn y = 0] (17) 

x >yeR(Gf xfe Wy 

where x = G^ r xA .a, a G GF(2) k and y = G^ r xfc b, b G GF(2) k \a. The first term can be calculated 
by using Theorem |2j Recall that V, is subspace that contain all the column vectors which are 
summation of i column vectors of G^ xfc , P, is the set of indices of the column vectors in V, 
and x* represents the a th , a G P, column vectors in V,. It can be readily shown that: 


X Pr [ G mxri X = 0 & G mx«y = 0] 

x .yeH(G p „ re xfc ),x^y 

= X] X Pr l G mxn X = 0 & G mx«y = 0] 

x eH(G pre xfc )y G i?(G pre x J\x 

k 

= EE E Pr [ G “xn< = 0&G“„y = 0] (18) 

i= i oer iyeR(G prc xfc )\xi 


where x( = G^ xfc a, |a| = i. Recall that y = G^ r xfc b, b G GF(2) k . We define three binary 
vectors z 0 , zi, and z 2 G GF( 2) k such that for t — 1, k, z 0 (f) = 1 if and only if a(t) = 1 and 
b(f) = 1 , zy(f) = 1 if and only if a (t) = 1 and b(f) = 0, and z 2 (f) = 1 if and only if a(£) = 0 
and b(t) = 1. Let w 0 ,wi and w 2 be the weights of vectors z 0 , zi, and z 2 , respectively. For x® , 
we have z 0 + zi = a and z 0 + z 2 = b. Hence we can obtain: 

Pr [ G mxX = 0 & G mx«y = 0] 

_ p r roLT ppre _ pLT ppre _ pLT ppre 

L''- r mxn''- r rrxfc Z 0 K -*mxn'^*nxk Zl 1 ' J mxn^ , nxf;"2 


z 0 | = l z i| = |z 2 | = w 2 


(19) 
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Let I z = {i z i,i z 2 ,... ,i ZT } be the set of indices such that t e / z for z(f) = 1, we can obtain the 
sets of indices of vectors z 0 , Z|, and z 2 as I ZQ , I Zl and I Z2 . Corresponding to the three sets I ZQ , 
I Zl and I Z2 , each column of the matrix G^ xk , gf re , 1 < i < k, can be divided into four mutually 
exclusive parts, g zo , g Zl , g Z2 and Ui<i< fc gf re \(g Zo U g Zl Ug Z2 ), i.e., g zo Hg Zl = {0}. Let g Z() be 
the subset of Ui<,;</,gf" : such that all the elements of this subset are selected from LJi <,;</, gf" : 
according to the indices in set I zo and G T " ( ' be the matrix whose columns are elements of g zo . 
The length of g Zo is w 0 . The same operation is applied to the formation of g Zl and g Z2 , in which 
the elements are selected according to the indices in set I Z1 and J Z2 , and have length uy and w 2 , 
respectively. Let x"'° = G^ o e l wo , x "’ 1 = G^ e l l()1 and x W2 = G^ r 2 e l W2 . Equivalently, equation 
(1251) can be rewritten as, 


p r |"pLT C' P re v _ pLT pre _ pLT ppre 


Z 0 | = W o& \zi\ = Wi& Iz 2 1 = w 2 


= Pr[G 


LT 


r w 0 


■ I 


u mXn A 


W2 _ 


iLT 


_ p — v 

u mXn A 




( 20 ) 


According to the law of total probability, we have 


PrfG LT x w ° = G lt x ™ 2 = G lt x™ 2 ! 

n-k-\-w o n—k-\-w\ n-k-\-w 2 

= 5Z J2 Pr[|x^°| = r 0 ] 

ro=wo r\ =w\ ro=w 2 

x Prflx"' 1 ! = ry] Prdx"' 2 ! = r 2 ] 

V Pr rr LT v ’" 0 = C LT y Wi = P LT Y 1 " 2 

1 1 ['J mXn A VJ m X n A u mxn A 

|x“°| = r 0 |x^| = ry |x™ 2 | = r 2 


( 21 ) 


For Pr[|x u ’°| = r 0 ], this can be calculated by using equation ©. Recall that the rows of G’;, r xri , 
i.e., gf, 1 < j < m, are random binary row vectors, which are generated independently. We 
have 


Pr [G“x 


r w 0 _ 


iLT 


— Q— v 

u mxn A 


w 1 _ 


iLT 


— Cl— y 

VJ mXn A 


w 2 
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r wo\ _ 


r w 1 I _ 


r W 2 I _ 


|x = rg |x = r\ |x \ = V 2 
= {Pr [gf:x“° = gfx ™ 1 = gfx 


W 2 


lx ™ 0 1 = r 0 lx "’ 1 1 = n |x ^ 2 1 = r 2 


( 22 ) 


Because all algebraic operations are conducted in a binary field, g'-'x "' 0 can only be 1 or 0. 
Equation (l22l) can be further written as : 


Pr [gfx ™ 0 = gf x ™ 1 = gfx ™ 2 


r m | _ 


r V3 1 I _ 


W 2 I _ 


x \ = Tq x a = r i x * = r 2 


= Pr [g} 


= 0 , gf x ™ 1 = 0 , gf x ™ 2 = 0 


x“°| = r 0 , lx "- 1 1 = ri, |x“" | = r 2 


till I ._ 


W 2 I _ 


Pr [g- 


LT v io 0 _ 


= 1, gfx™ 1 = 1, gf x™ 2 = 1 


r™ 0 | — 


X u | = r 0 , |x = ri, |X "I = r 2 


(23) 


Recall that x"’° = G^l^, x "' 1 = G^1 UI1 , x ™ 2 = G^l ,„ 2 and the columns of G^ e , Ggf, 
Gpre are mutually exclusive to each other. So event that x " 10 1 = r 0 is independent of event that 
lx 5 " 1 1 = rq or lx 1 " 2 ! = r 2 and the event that g' ;i x l ' :o = 1 is independent of event that g'-'x ’" 1 = 1 
or g y T x “ 2 = 1. Conditioned on lx™ 0 ! = r 0 , |x Wl | = r l5 |x™ 2 | = r 2 , the first part in equation (1231) 
can be expressed as: 


Pr [gfx“’° = 0, gj T x Wl = 0, gj T x W2 = 0 


lx’ 00 1 = Tq, |x^| = ri, |x^ 2 | = r 2 


Pr 

gfx W ° = o 

|x“’°| = r 0 

Pr 

g LT x «, 2 = q 

|x W2 | = r 2 


Pr 


gf x ™ 1 = 0 


W\ I ._ 


= r, 


(24) 


Based on the pervious analysis, we know that Pr Ig^x ’" 0 = 0 |x“’°| = r 0 ] only relates to 
parameter r 0 . Let D(w 0 ,r 0 ) = Pr[|x' u '°| = r 0 ] and J(r 0 ) = P^g^x ™ 0 = 0| |x^°| = r 0 ]. For 
J(r 0 ), it can be calculated by using equations (flTT) and (fl2l) . Based on the pervious analysis, 
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we know that J(r 0 ) only relates to parameter r 0 and D(w 0 ,r 0 ) is affected by parameter r 0 and 
w 0 - Hence for the same parameters w 0 , w’i and u; 2 , equations (l20l) has the same result. Because 
x a ~f~ y> we can obtain that wi + w 2 ^ 0 and w 0 + w 2 ^ 0. For x^, when |z 0 | = w 0 , we have 
Wi = i — w 0 and there are (^ ) possible combinations of z 0 . For z 2 , there are possible 
combination of z 2 when |z 2 | = w 2 . Inserting equation (l 20 l) . ([ 2 Tb . (1221) . ([23b and (l24b into (fl9l) . 
we can obtain: 


Pr l G «X = 0 & G mx«y = °] 

yGR(G|” xfc )V 4 
i k—i 

S l(wo + w 2 )l(wi + w 2 )0J(, 


k—i\ 
w 2 ) 


too=0 201 = 2—100 W2=0 
n-k-\-WQ n-k-\-w\ n-k-\-W2 

* E E E D(w 0 , r 0 )D(w 1 , r 1 )D(w 2 , r 2 ) 

tq=wq r\=w\ ro=W 2 

{J(r 0 )J(r 1 )J(r 2 )+7(ro)7(r 1 )J(r 2 )} m 


(25) 


0 if x = 0 

where l(x) := { . For x l a , x l Wa e V,, the probability Pr [G£ Xn x* = 0 & G^ xn y = 0] 

1 otherwise 

is affected by parameter i. So we can obtain that ^ xi _^ y P r [Gj^ x X = 0 & G^ xn y = 0 ] = 

X^xVy Pr [^mxn x a = 0 & G^ xn y = 0]. Recall that there are (■') indices in F. We can get that 

Pr ( G mxn x = 0 & G^ xn y = 0 ] 

x,yGR(GP re xfe ),x^y 

k 

=EE E Pr[G“ xn x* a = 0 & G^ T xn y = 0] 

i=i aeTi y eii(GP r xji )Y4 

A; z k—i 

i (^°+^ 2 ) i (^ i +« ; 2 ) 

2— 1 200=0 201=2—100 202—0 

n—/c+ioo n—fc+ioi n—/c+i 02 

*5J(iT) E E E O^o.roJD^.r,) 

7*0 =200 7*1 =20 1 7*0 =202 

x D(w 2 , r 2 ){J(r q) J(r i) J(r 2 ) + 7(r 0 )7(7*0 J(r 2 )} m (26) 


The proof of Theorem |3] is completed. 
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C. A Special Case of the Derived Bounds 

(k\ 

When we apply a special degree distribution-binomial degree distribution, i.e., Qj = r ,f l . . 1 < 
d < k, into Theorem [2l we can simplify equation ([[]) into a far less complex expression. The 
simplification procedure is shown in the following Corollary. 

Corollary 4. When the BS generates coded packets using the Raptor code (.k , C, Q,i) where C is 

(k\ 

(n, k, rf) LDPC code, Cl d = 1 < d < k and the coded packets received at a mobile user 

(MU) are decoded using the inactivation decoding algorithm, the probability that a MU can 
successfully decode all k source packets from m received coded packets with m > k , denoted 
by Pr satisfies 

( 2 n ~ 1 — 1 3 

Pr«) > 1 - (2* ~1)( (2 „ _ 1) r m) 

(n\ 

Proof: When new degree distribution, i.e., Cl d = Uf_ 1 . , 1 < d < n, is inserted into equation 
(flTI) . we can obtain that 


Pr[gfx‘ = 0 | |xi| = r\ 

n 

= (2“-l)-'Xi (XU) (28) 

d=1 s=0,2,...,2 LU 

When the upper limit of the inner summation is changed from 2 [|J to 2 [|J, it will not affect the 
result of equation (l28l) . This is because that ( d Zg) with s > 2 LIJ equals 0. The inner summation 
variable s is now independent of the outer summation variable d and thus the order of the two 
summations can be exchanged: 

Pr [gfxi = 0 | |x’„| = r] 

n 

= ( 2 ”-i)-‘( V oEGiD-OGiD-fco) (29) 

s=0,2,...,2[f J d=0 
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The terms ( d _l) restricts dtos<d<n-r + s, such that 

n n—r+s n—r 

Y.G-D = E 6-D = Eg - ') = 2 ” _r <30) 

d= 0 d=s d= 0 

Combining this term with the last expression for Pr[g|' T x* = 0 | x'',J = r] yields 




o 



= (2 n 


I )" 1 


( \ 

2 n-r ^ C)-i 

\ *=o. 2 -- 2 Lfj / 


= ( 2 n — l)~ 1 ( 2 n_r 2 r_1 — 1 ) 

( 2 n_1 - 1 ) 

(2 n - 1) 


(31) 

(32) 


where we have used identity X] S even(s) = 2 r_1 . We can observe that Pr[gj' T x* = 0 | |x^| = r] 
is independent from the weight of x. l a , hence Pr[G^„x^ = 0| x ( 'J = r] = Pr[G^, n x^ = 0]. 
Combining equation (fTOl) . (l32l) . © and ©, we can obtain that 


Pr[Pr[W m , n , k }) 

= Pr [(Jx6J!(Gr„)G“ > .„x = 0 

< E Pr = o] 

= (2‘-l)Pr[G“„x = 0||x|=r] 

= (2‘ - l)( ( p~ 1 _~) > )m <33) 


As for Theorem [3] we can simplify the upper bound into a far less complex expression as 
well. This is summarized in the following Corollary. 

Corollary 5. When the BS generates coded packets using the Raptor code (k. C, Q,i) where C is 

(k\ 

(n, k,r /) LDPC code, kl d = ^-i) > 1 < d < k and the coded packets received at a mobile user 
(MU) are decoded using the inactivation decoding algorithm /|3]/, the probability that a MU can 
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successfully decode all k source packets from m received coded packets with m > k , denoted 
by Pr (A k m fi satisfies 


Pr K) 

< 1 - (2 fc - 1) 
(2 n 1 - 


x 


( 2 n “ 1 - 1 ) 

(2 n - 1) 

3 


+ (2 fc - l)(2 fc_1 - 1) 


1 ) 


(2 n — 1) 


+ 


(2 n 1 - 1) 


(2 n - 1) 


(34) 


Proof: The new degree distribution, i.e., kl d = ^rrfy, 1 < d < n, is inserted into equation 
©, by using the result of equation (l32l) . we can obtain that 


J(r 0 ) = Pr[gfx^ = 0||x^|=r 0 ] 

( 2 n_1 - 1 ) 

(2 n - 1) 

Insert equation (l35l) into equation (l20l) . we can obtain that 


p r rr~' LT P"’ pre r, — r^LT fipre _ fiLT /-ipre 

^ L' or mxn''- , nxfc'^0 ^mxn^nxk^ 1 2 


z o| = I z l| = | z 2 1 = ^ 2 ] 


n— k-\-WQ n—k-\-w\ n—k+W2 

= E E E £>Oo, r 0 )D(w 1 , r 1 )D(w 2 , r 2 ) 

ro=iPo p 1 — iPy ro=iP2 


X{[ 

={[ 


(2” _1 - 1) 
(2 n - 1) 
(2 n_1 - 1) 
( 2 n - 1 ) 


F+[l 

] 3 +[l 


(2 n ~ l - 1) 
(2 n - 1) 
( 2 n_1 - 1 ) 
(2 n - 1) 


] 3 } 

] 3 } 


Insert equation (1361) into equation (1251) . we can obtain that 


Pr [Cn x i = 0&G“ xn y = 0] 

K^y 

i k—i 

= e yi yi i(w 0 +w 2 )i(wi+w 2 )(^ n )(^ 2 ') 

IU()=0 1«1=Z— Wq W2=0 


X{[ 


( 2 n_1 - 1 ) 
(2 n - 1) 


F + [l 


( 2 — 1 - 1 ) 

( 2 n - 1 ) 1 


(35) 


(36) 
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= (2 fc — 2){[ 


( 2 n_1 - 1 ) 
(: 2 n - 1 ) 


] 3 +[l 


( 2 n ~ 1 " 1 ) 3 
( 2 n - 1) J 1 


Combining equation (l37l) . (fl 8 l) and (fT71) . we can obtain that 


P *[Wm t n,k\ 


(a) 

> 


E Pr|G“ „x = 0 ] 


x eK(GP re xfc ) 


Pr [ G mxn X = 0&G^ xn y = 0] 


,yGR(GP rc xfc ),x^y 

( 2 n_1 - 1 ), 


(2 fe — 1)( 


( 2 ™ - 1 ) 


- x - 2 ) 


(2™” 1 - 1). 


i= 1 
in —1 


rr l 3 + [1 - ( > I " 


(2 n - 1) 


(2 fc - 1) 


( 2 n_1 — 1 ) 1 ' 
( 2 n - 1 ) 


( 2 n - 1 ) 

- (2 k - l)(2 fc_1 - 1) 


x 


( 2 n_1 - 1 ) 
( 2 n - 1 ) 


+ 


1 - 


( 2 n_1 - 1 ) 
(2 n - 1) 


(37) 


(38) 


Compared with the general expressions in Theorems [2] and [3] in the simplified expression 
of Corollaries |4] and 0 we can easily observe the relationship between the decoding success 
probability and the parameter of the encoding rules, i.e., k, n and m. 

IV. Simulation Results 

In this section, we use MATLAB based simulations to validate the accuracy of the analytical 
results and the tightness of the proposed performance bounds. Each point shown in the figures is 
the average result obtained from 100,000 simulations. The 95% confidence interval is also shown 
in each figure. For clarity, the simulation parameters adopted in this section are summarized in 
Table I. 
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Rateless Codes encoding parameters 

Number of source packets k 

20,40 

Number of intemediate packets n 

21, 41 

Parameter for bemoulli random variables // 

0.3, 0.7 

Pre-code C 

(n,k,rj) LDPC codes 

LT codes degree distribution 

Standard degree distribution 

D 3 GFF (a;)[l 6 l Annex B] 

Binomial degree distribution 

- (2 n_ 1} , 1 < d < n 

Ideal soliton degree distribution 

,2 <d<n 


and Oi = — 

Robust soliton degree distribution 

c = 0.04, 5 = 0.01 



Figure 2. The probabilities of successfully decoding all 20 source packets by the MU as a function of overhead 7 of transmission 
by the BS 


A. Verification of the Derived Bounds 

In this sub-section, the number of source packets is set to be k = 20, and the degree distribution 
of Raptor codes follows the widely used ideal soliton degree distribution Q. Besides, the pre¬ 
code C is assumed to be (21, 20, 0.3) and (21, 20, 0.7) LDPC codes. 

In Figs. [2] our analytical and simulation results are presented in terms of the probability 
Pr that the MU successfully decode all k = 20 source packets as a function of overhead 
7 = m/k of transmission by the BSs. As shown in Fig. [2] our analytical results, i.e., the upper 
and lower bound match the simulation results very well, which validates the accuracy of the 
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analysis in this paper. However, when overhead 7 is small, there is still a gap between the upper 
(lower) bounds and simulation results in Fig. [2l The gap between the exact value and the upper 
(lower) bound is caused by the approximation used in equation ©, and the gap between the 
exact value and the lower bound is caused by equation ([ 2 ]). 

B. Investigation of the Impact of Degree Distribution on the Decoding Success Probability 

When we fix the Pre-code C as (21,20,0.7), the degree distributions of Raptor codes are 
chosen as the widely used ideal soliton degree distribution, the robust soliton degree distribution 
|f4l , the standardized degree distribution in 3GPP 0 Annex B]: 

n 3GPP (x) = 0.0099x + 0.4663x 2 

+0.2144r 3 + 0.1152a; 4 
+0.1131a; 10 + 0.0811a; 11 


and a Binomial degree distribution proposed in this paper (see Table I). As shown in Fig. 


3(a) and 3(b), for different degree distributions, our analytical bounds are also corroborated 


by simulation results. Moreover, the performance of Raptor codes with the binomial degree 
distribution outperforms those with other three degree distributions. Additionally, the expression 
of decoding success probability of Raptor code with binomial degree distribution in Corollaries 
[5] and [4] has their computation superiority compared with the expression in Theorems [2] and [3] 
Therefore, we will focus on Raptor codes with the binomial degree distribution in the following 
simulations. 


C. Investigation of the Impact of k on the Decoding Success Probability 

When the number of source packets k increases from 20 to 40, our analytical results still tightly 
match the simulation ones. As can be seen from Fig. |4(a)| and |4(b)[ comparing transmitting 
20 source packets with transmitting 40 ones, the BS can reduce the overhead 7 = m/k of 
transmission that required to achieve the same performance, which leads to reduced transmission 
latency and energy consumption. 
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distribution, upper bound 
distribution, upper bound 
degree distribution, upper bound 
jgree distribution, upper bound 
distribution, lower bound 
distribution, lower bound 
degree distribution, lower bound 
jgree distribution, lower bound 
distribution, simulation 
distribution, simulation 
jgree distribution, simulation 
degree distribution, simulation 


Overhead y 


(a) Full Scale 



(b) Zoom of the rectangular box in (a) 

Figure 3. The probabilities of successfully decoding all 20 source packets by the MU as a function of overhead 7 of transmission 
by the BS 


D. Comparison of the Successful Transmission Probability for Raptor codes and Ideal Fountain 
codes 


In Fig. 5(a) and 5(b) we compare the Raptor code to an ideal fountain code together with the 


baseline transmission without coding. As can be observed from |5(a)| and |5(b)[ the performance 
gap between the Raptor code and the ideal fountain code is non-negligible because in the ideal 
fountain code the number of received symbols needed to decode the source symbols is exactly 
the number of source symbols, no matter which symbols are received. Hence, the decoding 
success probability of an ideal fountain code is as high as Pr (A'f) — 1 ,m> k. Besides, the 
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(a) Full Scale 



(b) Zoom of the rectangular box in (a) 


Figure 4. The probabilities of successfully decoding all 20 and 40 source packets by the MU as a function of overhead 7 of 
transmission by the BS 


coding gain of Raptor codes compared with the baseline transmission without coding is shown 
to be tremendous. We apply Raptor codes and an ideal fountain code into a single BEC channel 
with different erasure probability p. The probability that the receiver can decode all k source 
packets based on the successfully received coded packets, denoted as P suc , can be expressed as: 

T 


P,uc(T) = Y.O p r(A L m )p T --(l-py 


m=k 


As demonstrated in Fig. |5(a)| and |5(b)[ for different erasure probability p, transmission without 
coding can significantly reduce the overhead 7 = m/k of transmitting that required to achieve 
the same performance. When the target performance, e.g., the probability of successful delivery 
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is set to 0.95 for p — 0.1, the ratio of the number of packets transmitted without using coding 
to that using Raptor code equals 2.069; for p = 0.3, the ratio increases to 2.564. It seems that 
the ratio increases as the channel condition become worse. As for the comparison between the 
ideal fountain code and Raptor code, for the same target performance of0.95, for p = 0.1, the 
ratio of the number of packets transmitted with Raptor code to that using ideal fountain code 
equals 1.16; for p = 0.3, the ratio decreases to 1.11. It seems that the performance of Raptor 
code converges to that of the ideal fountain code when the channel condition become worse. 



X: 1.75 X: 1.95 



(b) p=0.3 

Figure 5. The probabilities of successfully decoding all 20 source packets by the MU as a function of overhead 7 of transmission 
by the BS 
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V. Conclusion 

In this paper we focus on finite-length Raptor codes and derive upper and lower bounds on 
packet error performance of Raptor codes under maximum-likelihood (ML) decoding, which is 
measured by the probability that all source packets can be successfully decoded by a receiver 
with a given number of successfully received coded packets. ML decoding ensures successful 
decoding when a full-rank matrix is received. Due to the concatenated coding structure of Raptor 
codes, we have analyzed the rank behavior of product of two random matrix. 

On the basis of the results presented in the paper, in the future, we plan to explore the optimum 
degree distribution and optimal parameter of Raptor codes in different channels. 

Appendix A: Proof of Lemma 1 

The event that (G LT ; H(„ —k)xn)(m+n—k)xn is a full rank matrix, i.e. its rank equals n, is 
equivalent to the event that (G LT G pre ) mX fc is a full rank matrix. 

Firstly we prove that the event that (G LT G pre ) mX k is a full rank matrix is a sufficient condition 
for the event that (G LT ; H( n _ fc ) xn )( m+n _ fe ) xn is a full rank matrix. Recall that H (n _ fc ) Xn = 

[P(n—fc)xfc|I(n—fc)](n—fc)xn 5 G nx ^, [Ifc | Pfcx (n— fc)] 3Ild H( n _j;) xn XG nx j, 0. If (G , H( n _/ C ) xn ) 

is a full rank matrix, we can obtain that (G iT ; H (ri ,_ fc ) xn ) x G pre = (G iT G pre ; 0(„_ fc ) Xfc )is of 
full rank, i.e., (G /;/ G , ' r ' ) rnx /, : is a full rank matrix. 


/ 


\ 


G 


LT 


( 


(G pre s T ) = 


Y H( n — k)xn J 


\ 


Y mx i 

Y 0(n—fc)xl J 


Then we prove that the event that (G LT G pre ) mX fc is a full rank matrix is a necessary condition 
for the event that (G LT ; H (n _ fc)xn ) (m+n _ fc)xn is a full rank matrix. Since H (n _ fe)x „ x G pr x \. = 
0, we can observe that row vector space of H( n _ fc ) xn span the left null space of G pr xfc , i.e., 

= n ((gz.: k n 
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s~i pre it T 

nxk n nx(n-t) 


/ \ 

Ifc P ky.(n—k) 

Y P(n— k)xk I(n— k) J 


As we can see that rank of ^ G p ™ k H£ x(n _ fc) J is n, the span of ^ G'^ k H^ x(n _ fc) J is 
Z£. Hence we can obtain that basis{N ((G p [ xk ) T )} = basis{R(H.J nk ^ xn )} = basis{li 2 }\ 
basis{R( G p lXk )}, i.e., basis{R( G p lXk )} Ubasis{N((G p nxk ) T )} = basis{ Z”}. By using the 
same idea, we can obtain that basis { i? (( G p [ xk ) T )} U basis { N (G pr x \.)} = basis{ Z^}. Once in 
binary field, no matter the formation of matrix, we have 6asis{f?((G) r )} U &asis{iV(G)} = 
basis {Z^}. For G^ xn , given that dim(Y(G^J D R(G p n r xk )) = 0, we can get 


basis{N(G^ xn )} 


= basis{Z2}\basis{R((G^ xn ) T )} C basis{E2}\basis{R(G p ^ xk )} 
=► basis{R(( GZnf)} => basis{R{ G% k )} 


Because basis{R(Hj n _ k)xn )} = basis{Z%}\basis{R( G p lXk )}, basis{(G LT \ H ( „_ fc)xn )} = 
basis{R((G^ xn ) T )} U basis{R(Hj n _ k)xn )} = basis{ Z£}. That is (G LT ; H (n _ fc)xn ) (m+n _ fc)xn 

is a full rank matrix, i.e. its rank equals n. 


Appendix B 

The event that Y = G L1 X, where X = G pre s T can be decoded by using ML decoding is 
equivalent to the event that (G LT G pre ) mX fc is a full rank matrix. 

Firstly when using a BEC channel, a encoded bit is either correctly received or lost. We 
consider Y' = G ,LT G pre s T as the encoded bits generated by Raptor encoder. After transmission, 
the coded bits a receiver correctly received can be expressed as Y = G L1 X, where G LT is a 
part of G' LT . Provided the rank of G LT is r, so the nullity of G LT is n — r. Using ML decoding 
to decode X from Y is equivalent to solve the linear equation Y = G L1 X by using Gaussian 
Elimination method. The set of solutions to Y = G LT X is an affine set. It has the form X = 
X 0 + iV(G iT ) = {Xq + x,x e N(G LT ) where X 0 = G pre s T and X 0 G R(G pre ). If we prove 
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that the event that (G Lr G pre ) rnxk is a full rank matrix is a sufficient condition for the event that 
(G ■ H( n _fc) xn )( m+n _/ c )xn is a full lank matrix. Recall that H(n—fc)xn [P(n—fc)xfc|I(n—fc)](n— k)xn 
, G p n r : k = [I*|P fex(n _ fe) ] r and H (n _ fc)xn X G% k = 0. If dim{iV(G^ x J n R{ G^)} = 0, i.e., 
N(GZ n ) n R(G p n r : k ) = {i^ce} X 0 + N(G LT ) £ R( G£ e fc ). So X 0 + N(G LT ) is not the final 
solution when using ML decoding. X 0 = Z is the unique solution left. So the condition that the 
ML decoding can decode X correctly, i.e., X has the unique solution, is that dim{ A r (G r ^ n ) n 
R(G^k)} = 0, which is equivalent to the condition that (G LT G pre ) mX k is a full rank matrix. 
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